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A METHOD OF SYNCHRONISING THE REPLAY OF AUDIO DATA IN A 
NETWORK OF COMPUTERS 

5 This invention relates to a method of synchronising the replay of audio 

data in a network of computers. 

Concomitant with the increased poptdarity of the Internet and intranets in 
recent years, there has been interest in combining digital data transmission with 
voice and other audio program content, including Internet radio, internet 
10 telephony, voice-mail, and unified messaging. In many businesses, such as 

financial dealing rooms, each person has a networked computer on their desk in 
addition to a telephone connected to a telecommunications system. 

A problem arises with such systems when a message contaiiiing audio data 
is sent simultaneously to a number of such networked computers within earshot 
15 of one another. The data is sent over the network as a series of data packets, 
which are reassembled at the destination computer and replayed. It is in the 
nature of such networks that the time taken for each data packet to travel over the 
network will be slightly different, depending on a number of factors such as how 
busy the network is at that time. Thus neighbouring computers can get their 
20 audio replay out of synchronisation, which can be annoying for the listener. 
Some of the reasons for a loss of synchronisation are:- 
1. Routing Variations - packets from a source (server) to a destination (client) 
may take different routes across the network, thus resulting in different arrival 
times at different clients and /or loss of packet order. 
25 2. Timebase Errors 0itter) - even if packets travelled the same route between 
server and client, there would be variations in arrival times due to network 
load and other uncontrollable factors. 
3. Error Correction - clients need to employ protocols to maximise the reliability 
of data transmission to deal with problems such as packet loss, corruption of 
30 data packets, and loss of order. These can involve further processing and 
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possible retransmission, which result in delays which exacerbate tiie above 
problems. 

4. Client Hardware - different client hardware can cause a given packet to be 
processed at different speeds by different dienls. Also, different sound 

5 processors may have calibration errors resulting in up to 3% variation in 
playback speed, 

5. Client Software - different operating systems and /or system configuration 
parameters and/ or applications run in parallel with the voice client may cause 
further variations in replay speed and thus give rise to a lack of 

10 synchronisation of clients within earshot of one another. 

An object of the present invention is to mitigate this problem. 
According to a the invention there is provided a method as specified in tiie 
claims. 

15 Methods for achieving multiparty synchronisation for real time network 

application have been described in US 5,682,384, However, these methods 
describe systems in which data from a plurality of sources arrives at a single 
destination station or client. The present invention concerns a different problem - 
that of lack of synchronisation where data from a single source arrives at a 

20 plurality of neighbouring destination stations or clients. 

Embodiments of the invention will now be described, by way of example 
only, with reference to the accompanjring schematic drawings, in which:- 
Figure 1 shows flow diagram of a method according to the invention, 
25 Figure 2 shows a block diagram of a client-server network, and 
Figure 3 shows a further client -server network, 

In computer networks using audio data, such as for example in dealing 
rooms, there are several forms of real time commimications. They are: 
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Broadcast - point to many simplex communications, this is typically used to 
transfer information - e.g. "Pepsi have bought 3 extra bottling plants in the UK 
their share price is expected to go unchanged" 

Intercom - typically point to point full duplex calls over ambient speakers, though 
5 typically the information is half duplex or question and aiiswer - e.g. "What is the 
Dollar Franc rate?" or "Fred your visitor is in reception?" 

Hoot and Holler - multipoint to multipoint conference, where again information 
is being disseminated and multiple people within a company will wish to 
communication to a large number of listeners around the world on the same 
10 subject. This is typically product related. 

Although today most of the communication is simply voice only, the 
ability to communicate with the addition of real time video and associated data 
(files, research, documentation) is desirable. 

In order to implement efficient commxmications a central sever is used with 

15 Broadcasts and Hoots to combine any incoming voice and data streams and 
routes the combined streams to intended recipients. An example of a network 
topology allowing this functionality is shown in Figure 2. This figure shows a 
network backbone (5), such as for example an Ethernet cable, coupled to a 
plurality of workstation computers (6) and a server (7). This is a typical example 

20 of a client-server architecture. With such a network topology it would be normal 
practice to have the server (7) control the data traffic in an analogous way to the 
central exchange (2) shown in Figure 1, with the workstation computers (6) acting 
in an analogooos way to the telephones (3) in Figure 1. 

To generate an input to a broadcast or an existing hoot in a system as 

25 shown in Figure 2, each "push to talk" voice data stream (and any video or other 
data) is routed from the workstation to the server, which then broadcasts a 
combined hoot voice stream to predefined workstations. The server can 
conveniently store the combined stream for later replay. 

In one example of such a system, described in our co-pending patent 

30 application number GB 9916871.8, the communication system has a first server 
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fimction that keeps track of permissions and usage and a second server function 
that combines voice streams or other data streams for broadcast and which 
provides storage means for storing the same data streams. The system also 
comprises a plurality of workstation computers each of which exchanges data on 
5 its intercom usage with the first server function, but which sends the intercom 
voice stream directly to the other workstation computer. Each workstation 
computer includes data storage means for storing the intercom voice stream for 
that particular workstation, such that the first server function is both able to keep 
track of intercom usage and subsequently to arrange for playback at any 

10 authorised point of any intercom message. The first and second server functions 
may be combined in a single server, or may be provided by separate servers. 

Figure 3 shows such a system in which both server functions are combined 
in a single server (10). This server has a part (11) which is allocated to store 
broadcast messages including audio data such as voice. The workstations (12) 

15 each have a data store (14) for storing intercom messages including audio data 
such as voice. It is within the scope of the present invention for each workstation 
to store any combination of its own outgoing and incoming intercom data 
streams. To reduce storage requirements, the two data streams may be combined, 
for example by smnming the two channels and storing this summed data, or by 

20 using other forms of compression appropriate for the type of data. 

The system implements broadcasts and hoots as follows. A person at a 
workstation computer (12) authorised to send such a message provides data to a 
routing server (10), usually in the form of data packets. These packets are 
combined into a single audio data stream at the server, which then sends the data 

25 stream out to a given subset of the workstations as a broadcast message, and 
stores this data in part 11. The broadcast message is then replayed by all the 
workstations participating in that particular hoot. 

An example of an embodiment of a method according to the present 
invention is shown schematically in the flow diagram of Figure 1. The following 

30 discussion assumes that data corresponding to voice messages is sent in variable 
sized packets. The packets received at the destination station are identical to those 
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sent from the source station, and the packets are received in the same order in 
which they were sent. If any of these conditions are not met, known techniques 
can be employed to tninimise voice loss. 

Block 20 denotes the start of the process. Block 21 denotes receiving a voice 
5 packet at a destination station over a network. Block 22 denotes deciding whether 
the received voice packet is the first of a voice spurt (i.e. the first packet in a 
connection or one preceded by non-voice packets). If it is the first. Block 23 
denotes storing the time it was received as the "start time". Block 24 denotes 
deciding whether the voice packet has arrived at the expected time, or whether it 

10 is late or early. If it arrives at the expected time, or is the first packet of a voice 
spurt (received at the ''start time")/ then Block 30 denotes waiting, so that the 
packet is sent to the soimd playing device (denoted by Block 31) with a 
predeterirdned delay time after the "start time''. If the decision at Block 24 is that 
it has not arrived at the expected time. Block 25 denotes deciding whether it has 

15 arrived later (shown as d>0) or earlier (shown as d<0) than expected. 

If it has arrived earlier than expected, in a conventional replay system it 
wotdd just be delayed for a bit longer before replay. However, one possibility is 
titat the "start time" for the destination station being considered was later than its 
neighbours due to routing or other delays. Under such conditions; neighbouring 

20 destination stations would start replaying the voice at different times. In the 
present invention. Block 27 denotes determining a corrected "start time", either 
by subtracting the amount of time by which the voice packet has arrived earlier 
than expected from the original "start time", or by calculating a mean or average 
"start time'' to be used in place of the original "start time". 

25 If the voice packet has arrived later than expected, but before it should be 

played, then it is placed in the queue with a shorter delay time. If the mean or 
average "start time" is being used rather than the rrdnimum time, it must be 
recalculated, taking into account this longer arrival time. If a voice packet arrives 
later than it should have been played it is ignored. The travel times of packets 

30 arriving so late are not used to calculate the average travel time. It is important to 
have a sufficiently long delay that not many packets are ignored in this way. 
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The voice data is stored in a FIFO buffer prior to being sent to the soimd 
replay device. Block 26 denotes deciding upon what to do when this buffer 
beconnes empty of voice data (sometimes known as an undervoice condition). 
Block 29 denotes resetting the start time and waiting for a new voice spurt to 
5 begin. If the buffer is not empty, it is possible that it might become too fuU and 
over flow. If that happens. Block 28 denotes removing excess voice data. There are 
known techniques for performing this task^ such as removing silences or playing 
the voice data faster in real time, Blocks 30 and 31 have the same meanings as 
before. 

10 Apparatus for putting the present invention into effect can comprise a 

suitably programmed general purpose computer, including a sound card or other 
sound output mearxs. 

When the average travel time is being calcxilated, it is necesary to disregard 
very large travel times associated with lost data packets which wotild otherwise 

15 distort the average* 


